Enabling Access to Mass Storage
نویسنده
چکیده
A number of different mass storage systems are in use in the scientific communities. The Storage Element (SE) is a Grid interface to storage systems being developed as a part of the European Union DataGrid project [EDG]. It enables Grid clients to access data in the storage systems in a uniform way, i.e. without knowing which storage system they are talking to. The SE provides a flexible interface to various storage systems, and can provide additional functionality not provided by the storage itself, such as access control, or automatic replication across sites. We describe the current status of the SE, how experiments are using or will be using the SE, and future developments. We describe in detail some aspects of single sign-on authentication and delegation, and an overview of message queueing systems for the future development of the SE. This work will be of interest to anyone with large scale storage requirements, e.g. the UK Grid community, but this work will also be of interest to individual Grid developers.
منابع مشابه
On Configuring Hierarchical Storage Structures
The rapid progress in mass storage technology is enabling designers to implement large databases for a variety of applications. The possible configurations of the hierarchical storage structures (HSS) are numerous and result in various tradeoffs, e.g., storage cost, throughput, initial latency, etc. A naive design might waste system resources and result in high cost. For example, one naive desi...
متن کاملEnabling Object Storage via shims for Grid Middleware
The Object Store model has quickly become the basis of most commercially successful mass storage infrastructure, backing so-called ”Cloud” storage such as Amazon S3, but also underlying the implementation of most parallel distributed storage systems. Many of the assumptions in Object Store design are similar, but not identical, to concepts in the design of Grid Storage Elements, although the re...
متن کاملOn-demand Grid Storage Using Scavenging
Increasingly scientific discoveries are driven by analyses of massively distributed bulk data. This has led to the proliferation of high-end mass storage systems, storage area clusters and data centers as storage fabric elements for the Grid, offering excellent price/performance ratio and good storage speeds, but increasing maintenance and administrative costs. A promising alternative then, is ...
متن کاملOpenMSI: a high-performance web-based platform for mass spectrometry imaging.
Mass spectrometry imaging (MSI) enables researchers to directly probe endogenous molecules directly within the architecture of the biological matrix. Unfortunately, efficient access, management, and analysis of the data generated by MSI approaches remain major challenges to this rapidly developing field. Despite the availability of numerous dedicated file formats and software packages, it is a ...
متن کاملpNFS and Linux: Working Towards a Heterogeneous Future
Heterogeneous and scalable remote data access is a critical enabling feature of widely distributed collaborations. Parallel file systems feature impressive throughput, but sacrifice heterogeneous access, seamless integration, security, and cross-site performance. Remote data access tools such as NFS and GridFTP provide secure access to parallel file systems, but either lack scalability (NFS) or...
متن کامل